UI on the Fly: Generating a Multimodal User Interface
نویسندگان
چکیده
UI on the Fly is a system that dynamically presents coordinated multimodal content through natural language and a small-screen graphical user interface. It adapts to the user’s preferences and situation. Multimodal Functional Unification Grammar (MUG) is a unification-based formalism that uses rules to generate content that is coordinated across several communication modes. Faithful variants are scored with a heuristic function.
منابع مشابه
The Evaluation of Adaptable Multimodal System Outputs
Adaptable multimodal systems are difficult to test. We present a methodology for evaluating parallel multimodal output which is generated in response to a specific set of user, device, and situation constraints. We focus on the generation of multiple variants of user interfaces for small-screen graphical devices with natural language voice output, within a system we term UI on the Fly. Our meth...
متن کاملReview and comparison of User Interface Characteristics of (Springer, Elsevier, Ebsco, ISI(WOS) and Ovid) as Perceived by University of Tehran Users
Background and Aim: The present investigation intends to compare and review various user interfaces from user standpoint and to ascertain its linkage with user satisfaction. Method: The research incorporated a descriptive survey of University of Tehran graduate student body. Using a targeted sampling, graduate students from the faculties of chemistry and Biology were selected. The instruments u...
متن کاملScientists in the MIST: Simplifying Interface Design for End Users
We are building a Malleable Interactive Software Toolkit (MIST), a tool set and infrastructure to simplify the design and construction of dynamically-reconfigurable (malleable) interactive software. Malleable software offers the end-user powerful tools to reshape their interactive environment on the fly. We aim to make the construction of such software straightforward, and to make reconfigurati...
متن کاملDecoupling of Modality Integration and Interaction Design for Multimodal Human-Robot Interfaces
The development of a multimodal Human-Robot Interface (HRI) involving mixed-initiative and context-awareness is complex and laborious. The integration of individual modalities (e.g., gesture recognition or speech output) and the design of natural human-robot interaction are two different tasks that both require their own expertise. In this paper, we consider three different roles that participa...
متن کاملMultimodal Interactive User Interfaces for Mobile Multi-Device Environments
Portable devices come with different individual limitations in user interaction like limited display size, small keyboard and different sorts of input and output channels. To allow ubiquitous, peripheral interaction, a flexible way to provide user interfaces for multiple devices and their different modalities is needed. However, current systems and formats do not sufficiently integrate advanced...
متن کامل